Immersive display

ABSTRACT

A method of operating an immersive display includes obtaining first images of environment in a first region in front of the immersive display, obtaining second images of environment in a second region outside the first region, which second region is not in front of the immersive display, displaying the first images of the environment on a first area of at least one display of the immersive display to provide a field of view of the environment in front of the immersive display, and displaying the second images of the environment in the second region on a second area of the at least one display to provide images outside the field of view of the environment in front of the immersive display. The first area is delineated from the second area.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to and is a continuation of U.S.application Ser. No. 16/673,861, filed Nov. 4, 2019, which is acontinuation of application Ser. No. 15/206,100, filed Jul. 8, 2016(U.S. Pat. No. 10,464,482, issued on Nov. 5, 2019), which claimspriority to U.S. provisional application Ser. No. 62/195,201, filed Jul.21, 2015, which applications are specifically incorporated herein, intheir entirety, by reference.

FIELD OF TECHNOLOGY

The present disclosure relates to immersive displays such asthree-dimensional (3D) displays for displaying virtual or augmentedreality environments.

BACKGROUND

Immersive displays are becoming increasingly popular for the purpose ofplaying games in a virtual reality environment. These immersive displaysmay also be utilized for applications other than gaming, including, forexample, augmented reality applications. The virtual world oraugmented-reality is currently commonly perceived by the user based ontwo images, with each of the two images displayed close to a respectiveone of the user's eyes.

Such displays are often head-mounted and in many cases block out some orall of the real environment around the user in order to immerse theuser, for example, in the virtual world. Thus, these displays mayobstruct or block the user's vision of his or her surroundings. Thevirtual world or augmented-reality is perceived by the user based onimages displayed very close to the user's eyes.

Improvements in immersive displays and applications or uses of suchimmersive displays are desirable.

SUMMARY

According to one aspect, a method of controlling an immersive display isprovided. The method includes obtaining first images of environment in afirst region in front of the immersive display, obtaining second imagesof environment in a second region outside the first region, which secondregion is not in front of the immersive display, displaying the firstimages of the environment on a first area of at least one display of theimmersive display to provide a field of view of the environment in frontof the immersive display, and displaying the second images of theenvironment in the second region on a second area of the at least onedisplay to provide images outside the field of view of the environmentin front of the immersive display. The first area is delineated from thesecond area.

According to another aspect, an immersive display is provided. Theimmersive display includes a body, at least one display on the inside ofthe body for displaying images in front of a user's eyes, and aprocessor coupled to the display. The processor is operable to obtainfirst images of environment in a first region in front of the immersivedisplay, obtain second images of environment in a second region outsidethe first region, which second region is not in front of the immersivedisplay, display the first images of the environment on a first area ofat least one display of the immersive display to provide a field of viewof the environment in front of the immersive display, and display thesecond images of the environment in the second region on a second areaof the at least one display to provide images outside the field of viewof the environment in front of the immersive display. The first area isdelineated from the second area.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the present disclosure will now be described, by way ofexample only, with reference to the attached Figures, in which:

FIG. 1 is a system for providing a multi-user virtual event;

FIG. 2 is a simplified block diagram of an example of an immersivedisplay of the system of FIG. 1; and

FIG. 3 is a flowchart illustrating an example of a method of controllingthe display of information on an immersive display.

DETAILED DESCRIPTION

For simplicity and clarity of illustration, reference numerals may berepeated among the figures to indicate corresponding or analogouselements. Numerous details are set forth to provide an understanding ofthe examples described herein. The examples may be practiced withoutthese details. In other instances, well-known methods, procedures, andcomponents are not described in detail to avoid obscuring the examplesdescribed. The description is not to be considered as limited to thescope of the examples described herein.

The following describes an immersive display and a method of controllingthe immersive display. The method includes obtaining first images ofenvironment in a first region in front of the immersive display,obtaining second images of the environment in a second region outsidethe first region, which second region is not in front of the immersivedisplay, displaying the first images of the environment on a first areaof at least one display of the immersive display to provide a field ofview of the environment in front of the immersive display, anddisplaying the second images of the environment in the second region ona second area of the at least one display to provide images outside thefield of view of the environment in front of the immersive display. Thefirst area is delineated from the second area.

A system 100 for providing a multi-user virtual event is illustrated inFIG. 1. The system includes servers 102 that are coupled to a network104 or networks, which includes the internet and may optionally includea cellular network through which several client devices, nodes, orterminals may be connected. In the example of FIG. 1, five clientdevices are coupled to the network 104, including desktop computers 106,108, 110, a laptop computer 112 which is coupled to the networkwirelessly through a modem 114, and a smartphone 116. The servers 102store and execute software or firmware and communicate and cooperatewith software and firmware on the client devices 106, 108, 110, 112, 116via the network. The software and firmware on the client devices 106,108, 110, 112, 116 also communicate and cooperate with software andfirmware on respective immersive displays that may be worn by the users.

The servers 102, utilizing the software or firmware, provide the virtualenvironment, which may be a three-dimensional virtual environment. Theenvironment may be any suitable environment for a game, a social networkor interaction site, a meeting environment, such as a boardroom ormeeting room, a classroom, a conference room or any other room or otherscene. The virtual environment provided is dependent on the applicationand may be dependent on any other suitable factor such as the number ofparticipants.

The servers 102 also manage authorization of users via client devices tofacilitate participation in the virtual environment by avatarsrepresenting the users. The avatars enter the virtual environment totake part in or attend an event such as a game, a social network eventor interaction, a meeting, class, conference or other event.

The images, including virtual images and a virtual environment, may beprovided to the client devices 106, 108, 110, 112, 116 for displayutilizing the immersive displays, which may be, for example,head-mounted displays worn by the users.

A simplified block diagram of an example of an immersive display 200 isshown in FIG. 2. The immersive display 200 includes multiple components,such as a main processor 202 that controls the overall operation of theimmersive display 200. The immersive display is head mounted.

Optionally, the immersive display may be incorporated into a helmet,such as a bicycle helmet, skateboard helmet, motorcycle helmet, ski orsnowboard helmet, or any other suitable helmet. Optionally, the helmetearphones or headphones integrated into the helmet in addition to or inplace of a speaker.

The main processor 202 interacts with other components of the immersivedisplay 200, including, for example, a temporary storage device 204, amemory 206, a display device 208, a speaker 210, an auxiliaryinput/output (I/O) subsystem 212, external cameras 214, one or moreinternal cameras 216, one or more microphones 218, anorientation/movement sensor 220, one or more proximity sensors 222, acommunication subsystem 224, short-range communications 226, a powersource 228, and, optionally, other subsystems 230.

The temporary storage device 204 may be, for example, Random AccessMemory (RAM) that stores data that is processed by the main processor202. The memory 204, such as flash memory, is utilized for persistentstorage.

The immersive display 200 provides video output through the display 208,which includes an interface, a controller and at least one display. Forexample, the immersive display may include a pair of displays to displayimages. The images displayed in this example include a respective imagein front of each one of the user's eyes such that a right side image isdisplayed in front of a user's right eye and a left side image isdisplayed in front of a user's left eye. In addition to the display 208,output is provided via the speaker 210 or other audio output such asheadphones or earphones. The auxiliary input/output (I/O) subsystem 212includes an interface through which, for example, a USB controller orother peripheral device may be connected.

Input to the immersive display may be provided via external sensors orinput devices such as the external cameras 214 mounted on the body ofthe immersive display 200. The external cameras 214 may include multiplecameras to obtain images extending around the user, i.e., 360° aroundthe user. The external cameras 214 may also include cameras to obtainimages in an upward direction from the user, and in a downward directionfrom the user. Each of the cameras includes the functional componentsfor operation of the camera, including the lens, the image sensor, and,optionally, a light sensor and light source, such as infrared lightemitting diodes (LEDs). Thus, the cameras provide images of the user'senvironment or surroundings. The cameras may be one or more of visuallight cameras, 3D sensing cameras, light field cameras, forward lookinginfrared cameras, near infrared cameras, ultraviolet cameras, or otherimaging devices.

The terms upward and downward are utilized herein to generally describedirection of view of the external cameras 214 relative to the user whenthe immersive display is worn by the user and the user is in an uprightposition, and such terms are not otherwise limiting.

The one or more internal cameras 216, referred to herein as the internalcamera 216, may be mounted on an inside of the body of the immersivedisplay and includes the functional components for operation of eachinternal camera, including the lens, the image sensor, and a lightsource, which may be a light source in the non-visible spectrum, such asinfrared LEDs. Although the interior of the immersive display 200 may bedark because exterior light is blocked out or partially blocked out, thelight source provides sufficient light for use of the internal camera216.

The one or more microphones, referred to herein as the microphone 218,may also be mounted in the body of the immersive display 200 to provideinput by converting audible information to electrical signals, which maybe processed by the main processor 202 and may be transmitted to anotherelectronic device to which the immersive display 200 is coupled. Forexample, the immersive display may be coupled to a smart-phone, a laptopcomputer, a tablet, a desktop computer, a game device, and any othersuitable electronic device.

The main processor 202 also receives signals from theorientation/movement sensor 220, which is coupled to the body of theimmersive display 200. The orientation/movement sensor may be, forexample, an accelerometer, a gyro sensor, or any other suitable sensoror combination of sensors that is or are utilized to detect direction ofmovement, direction of gravitational forces, and reaction forces so asto determine, for example, the orientation of the immersive display 200and the movement of the immersive display 200.

The one or more proximity sensors, referred to herein as the proximitysensors 222, may provide additional input to the main processor 202 todetect the presence of objects that are near or proximal to the sensorand thus to the user when the immersive display 200 is in use. Theproximity sensors 222 may be any suitable proximity sensors such as acapacitive or photoelectric proximity sensor.

The communication subsystem 224 receives signals from another electronicdevice such as the client devices 106, 108, 110, 112, 116 shown in FIG.1, and sends signals to the other electronic device to which theimmersive display is coupled. Thus, for example, the signals from themicrophone 218 or signals from the external cameras 216 or from theinternal camera 216 may be sent via the communication subsystem 224. Thecommunication subsystem 224 is also responsible for receiving signalsfrom the other electronic device for processing by the main processor202 to cause images, which may include video, to be displayed on thedisplay 208 and for audio to be output through the speaker 210.

The immersive display 200 optionally includes short-range communications226 to perform various communication functions. For example, theimmersive display 200 may include BLUETOOTH® or infrared (IR)communications capability, for example, for communicating with aperipheral device or accessory.

The power source 228 may be one or more rechargeable batteries or a portto an external power supply to power the immersive display 200.

The systems and subsystems that interact with the main processor 202 andare described herein are provided as examples only. Other subsystems 230may also interact with the main processor 202.

Utilizing the images from the internal camera 216, the main processor202 may be operable to track eye motion. To track eye motion, the user'spupils may be tracked when the immersive display 200 is in use. The eyemotion tracking may also facilitate determination of what a user islooking at, for example, by triangulation to determine depth of anobject or image that a user is looking at. Alternatively, the internalcamera 216 may identify or track changes in muscles or muscle motionaround at least one of the user's eyes to identify movement of the eye,or may track changes in shape of a lens of an eye or changes in shape ofthe lens of each eye to identify a focal distance, facilitatingidentification of the depth of focus of a user.

In one aspect, variable focal optical elements, such as the SUPERFOCUS™glasses may be utilized and controlled digitally to create a morerealistic blur effect. Areas that are set to be blurred may be renderedwith fewer pixels.

Based on the eye motion tracking, the direction that the user is lookingmay be identified. The direction may be, for example, an angle orangles, such as angular offset or offsets from straight ahead. Thus,when a user glances upwardly, downwardly, or to either side, thedirection is identified and the images displayed utilizing the display208 may be changed or adjusted based on the direction.

The main processor 202 is also operable to analyze the images from theinternal camera to track or identify a change in facial expression. Forexample, the main processor 202 may utilize primary facial featuretracking by tracking features such as lips, nose, and eyes.Alternatively, or in addition, movement of parts of the face may betracked. The main processor 202 may transmit facial expression data oran identification of the expression to the other electronic device towhich the immersive display 200 is coupled via the communicationsubsystem 222.

The main processor 202 is also operable to receive the image data fromthe external cameras and to transmit the data to the other electronicdevice, along with metadata for at least key frames for identifying theimage data such that the images can be stitched together to provideimages of the user's surroundings. Thus, the images from each of thecameras can be stitched together to obtain images of the user's entiresurroundings.

A flowchart illustrating a method of controlling an immersive display isshown in FIG. 3. The method may be carried out by software executed, forexample, by the main processor 202 of the immersive display 200, by oneor more of the client devices 106, 108, 110, 112, 116, or by anycombination of the immersive display 200, a client device and one ormore of the servers 102. Coding of software for carrying out such amethod is within the scope of a person of ordinary skill in the artgiven the present description. The method may contain additional orfewer processes than shown and/or described, and may be performed in adifferent order. Computer-readable code executable by at least oneprocessor to perform the method may be stored in a computer-readablemedium, such as a non-transitory computer-readable medium.

Images are obtained at 302, for example, by processing images from theexternal cameras 214 of the immersive display 200. The images are imagesof the environment that is generally in front of the immersive display200. The environment that is generally in front of the immersive display200 includes images of a peripheral area. The images may include imagesof the environment extending about 180°. The images may be generallycentered on the immersive display 200 or may be centered on a directionthat the user is looking or direction of gaze, as determined utilizingthe internal camera 216, for example by eye motion tracking or facialfeature tracking.

The images obtained may include images for displaying a right side imagein front of a right eye and a left side image in front of a left eye ofa user of the immersive display 200 to provide a virtual 3-D image forthe user.

Images of the environment that is not in front of the immersive display,for example, behind the immersive display 200 or to the left or rightside of the immersive display 200, are also obtained at 304. The imagesmay include images of the environment extending about 180° around a backside or rear of the immersive display 200. Thus, with the images of theenvironment extending about 180° around a front of the immersivedisplay, images extending 360° around the immersive display 200 areobtained. The images may be obtained by processing images from externalcameras 214 that are directed to the rear or to sides of the immersivedisplay 200. Alternatively, the images may be communicated from anotherelectronic device. According to one example, images may be obtainedutilizing cameras, such as a rearview camera, in a vehicle. The vehiclemay be in communication with a respective client device 106, 108, 110,112, 114, or may communicate directly with the immersive display 200,for example, by BLUETOOTH® communication to send images to the clientdevice or immersive display 200.

The images obtained at 302 and the images obtained at 304 need not beobtained in separate steps. These images may be obtained together, forexample by obtaining panoramic views or may be obtained utilizing a 360°camera.

At 306, the images of the environment that is generally in front of theimmersive display 200, are displayed on a first area of the display 208.Thus, for a display 208 that includes two display screens, each disposedin front of and very close to a respective eye of a user, theenvironment is displayed in a first area on each of the display screens.The images are displayed on the display 208 to provide the user with agenerally full field of view of the environment generally in front ofthe immersive display 200. The view may be a full field of view based onthe orientation of the immersive display 200 or based on the directionin which the user is looking.

At 308, the images of the environment that is not in front of theimmersive display, for example, behind the immersive display 200 or tothe left or right side of the immersive display 200, are also displayedon the display 208. The images are displayed to provide a view of theenvironment that is generally outside the full field of view of theenvironment in front of the immersive display 200. For example, theimages may be images that are behind the user. The images are displayedin a second area of the display 208 to provide a view of areas that, inthe absence of the immersive display 200, would be out of the field ofview of the user. The two areas of the display 208 therefore may displayimages of the environment extending a complete 360° around the immersivedisplay 200 and therefore around the user.

The images are displayed in a second area of the display 208 that isdelineated from the first area. For example, the images may be displayedon an image of a rearview mirror, to delineate the images of theenvironment that is generally in front of the immersive display 200 fromthe images of the environment that is generally to the rear of theimmersive display 200. The images may also or alternatively bedisplayed, for example, on an image of a sideview mirror or mirrors.Alternatively, the images may be delineated utilizing delineation linesor borders between the images, or utilizing any other suitable techniqueto facilitate identification of the images as images of the environmentthat is generally to the rear of the immersive display 200.

Optionally, the images displayed in the second area are displayed inresponse to a user looking in a particular direction. For example, eyetracking or facial tracking may be utilized to determine when a userglances upwardly and, in response to determining that the user glancesupwardly, the images may be displayed to provide a view of theenvironment generally to the rear of the immersive display. The imagesmay also or alternatively be displayed in response to the user glancingto the left or right. Thus, the images are not displayed until the userglances toward the delineated area or areas.

In the example of use of the immersive display in communication with aprocessor of a vehicle, the images may also be displayed in response todetecting or determining that the vehicle is put in reverse gear, whenan object, such as another vehicle is detected in a blind spot, or isdetected on one side of a vehicle.

The external cameras may also be utilized to detect movement, forexample, in an area outside the field of view and the images may bedisplayed in the delineated area based on the detected movement, forexample, or based on proximity of detected movement.

Optionally, the different areas may be displayed utilizing differentattributes. For example, the first area, in which the displayed imagesare processed images of the environment generally in front of theimmersive display 200, is displayed utilizing first display attributes.The second area, in which processed images from the rear of theimmersive display are displayed, is displayed utilizing second displayattributes. For example, the two areas may be displayed at differentresolutions and different refresh rates. Thus, the images in the secondarea may be displayed at lower resolution and a lower refresh rate.

The method illustrated in FIG. 3 is continuous such that the images arecontinuously updated on the display 208 of the immersive display 200 todisplay the environment generally in real time or close to real time.

Optionally, data from multiple virtual or real world sources may beaggregated on the display 208, against a single background. For example,the depth of field for objects from a first source is narrowed andplaced behind a similarly narrowed depth of field for objects from asecond source. Data from more than two sources may be aggregated. In oneexample, a field may be used as a background object. In the example of avirtual reality game or a virtual environment, images from the game orthe virtual environment may be displayed within a perceived depth offield of, for example, from 10 centimeters to 3 meters. Images from thereal world or augmented reality may be displayed at a perceived depth offield of, for example, from 4 meters to infinity. Thus, in this example,the images of the environment that are obtained, for example, from theexternal cameras 214, are displayed in two areas of the display, whichareas are delineated from each other, at a perceived depth of field offrom 4 meters to infinity.

In one implementation, virtual reality or augmented reality isintegrated with images of the actual or real environment by, forexample, making part of or the entire perceived closest imagesemi-transparent.

In another implementation, a game or virtual environment may bedisplayed at 50% opacity with an altered and/or slightly or fullyflattened depth of field, for example, perceived as from 30 centimetersinches to 3 meters. The actual or real environment may be displayed withan altered and/or slightly or fully flattened depth of field, perceivedas from 3.1 meters to infinity. Optionally, user eye movements may betracked and utilized to alter the opacity of a portion of the image orimages from one source, to invert the foreground and background images,to change the perceived depth or amount of flattening, to make imagesfrom one source have negligible depth of field allowing a fuller depthof field in the images from the other source without overlapping, or anysuitable combination thereof.

According to one example of the method of controlling the immersivedisplay 200, images from a virtual environment are displayed on thedisplay 208 of the immersive display 200 at a perceived depth of greaterthan 3 meters, for example.

In addition, images are obtained at 302, for example, by processingimages from the external cameras 214 of the immersive display 200. Theimages are images of the environment in front of and generally centeredon the immersive display. The images include a peripheral area toprovide a generally full field of view for the user. Images from behindthe immersive display 200 are also obtained at 304 utilizing externalcameras 214.

At 306, the images of the environment that is generally in front of theimmersive display 200, are displayed on a first area of the display 208,at a depth of up to 3 meters and with an opacity of 50% to provide theuser with a generally full field of view of the environment generally infront of the immersive display 200 while facilitating viewing thevirtual environment. At 308, the images that are from the rear of theimmersive display 200 are displayed above the images from the front ofthe immersive display 200 and separated by a black line to delineate theimages.

According to another example of the method of controlling the immersivedisplay 200, only real world images are displayed for the purpose ofdriving, for example a car. Images are obtained at 302, for example, byprocessing images from the external cameras 214 of the immersive display200. The images are images of the environment in front of and generallycentered on the immersive display. The images include a peripheral areato provide a generally full field of view for the user. Images frombehind the car are processed from images received from a rear viewcamera of the car in communication with the immersive display 200, forexample, via a client device to which the immersive display 200 iscoupled.

At 306, the images of the environment that is generally in front of theimmersive display 200 are displayed on a first area of the display 208to provide a view through the windshield of the car and through a driverside window and a passenger side window of the car. At 308, the imagesthat are processed from the rear view camera are displayed on an imageof a rear view mirror.

According to yet another example of the method of controlling theimmersive display 200, the immersive display 200 is integrated into ahelmet to provide protection for the user and is worn, for example,while the user is cycling. Images are obtained at 302, for example, byprocessing images from the external cameras 214 of the immersive display200. The images are images of the environment in front of and generallycentered on the immersive display. The images include a peripheral areato provide a generally full field of view for the user. Images frombehind the immersive display 200 are also obtained at 304 utilizingexternal cameras 214.

At 306, the images of the environment that is generally in front of theimmersive display 200, are displayed on a first area of the display 208.At 308, the images that are from the rear of the immersive display 200are displayed above a horizon line of the road and are separated, forexample, by a line to delineate the images. The views from behind mayinclude a full view of areas not normally visible to the user whenlooking forward. Thus, the images displayed at 208 provide the user withimages of the environment behind and to the sides of the immersivedisplay 200, without requiring the user to turn around or adjust theirhead position or orientation.

Advantageously, views of areas of the environment that are toward a backor rear of the immersive display 200, such as areas directly behind aswell as areas behind and to the sides of the immersive display 200, aredisplayed in addition to a field of view toward the front of theimmersive display 200. Thus, areas that are not visible to the userwithout the use of the virtual display 200, are displayed and arediscernible from the images taken from the front of the immersivedisplay 200. The images from areas other than in front of the immersivedisplay 200 can be viewed by moving one's eyes and without requiring theuser to turn around or adjust their head position or orientation.

The described embodiments are to be considered as illustrative and notrestrictive. The scope of the claims should not be limited by thepreferred embodiments set forth in the examples, but should be given thebroadest interpretation consistent with the description as a whole. Allchanges that come with meaning and range of equivalency of the claimsare to be embraced within their scope.

What is claimed is:
 1. An immersive display, comprising: a body; atleast one display inside of the body for displaying images to a user ofthe immersive display; a processor coupled to the at least one displayand operable to: obtain first images for display on the at least onedisplay, where the first images are captured by one or more cameras;obtain second images for display on the at least one display from one ormore second cameras, where the one or more second cameras capture, atleast in part, a region not in front of the immersive display; displaythe first images in a first area of the at least one display; anddisplay the second images in a second area of the at least one display.2. The immersive display of claim 1, where the first images aredisplayed at a location without reference to a correspondence betweenthe location and a region captured by the one or more first cameras. 3.The immersive display of claim 1, where the second images are displayedat a location that does not correspond to the region captured by the oneor more second cameras.
 4. The immersive display of claim 1, where alocation of the second area corresponds to an area substantiallyhorizontally adjacent to the first area.
 5. The immersive display ofclaim 4, where the location of the second area does not correspond to anarea substantially vertically adjacent to the first area.
 6. Theimmersive display of claim 1, where a location of the second areacorresponds to an area substantially vertically adjacent to the firstarea.
 7. The immersive display of claim 6, where the location of thesecond area does not correspond to an area substantially horizontallyadjacent to the first area.
 8. An immersive display, comprising: a body;at least one display inside of the body for displaying images to a userof the immersive display; a processor coupled to the at least onedisplay and operable to: obtain first images for display on the at leastone display, where the first images are obtained by using one or moreimages from a library of images; obtain second images for display on theat least one display from one or more second cameras, where the one ormore second cameras capture, at least in part, a region not in front ofthe immersive display; display the first images in a first area of theat least one display; and display the second images in a second area ofthe at least one display.
 9. The immersive display of claim 8, where thesecond images are displayed at a location without reference to acorrespondence between the location and the region captured by the oneor more second cameras.
 10. The immersive display of claim 8, where thesecond images are displayed at a location that does not correspond tothe region captured by the one or more second cameras.
 11. The immersivedisplay of claim 8, where a location of the second area corresponds toan area substantially horizontally adjacent to the first area.
 12. Theimmersive display of claim 11, where the location of the second areadoes not correspond to an area substantially vertically adjacent to thefirst area.
 13. The immersive display of claim 8, where a location ofthe second area corresponds to an area substantially vertically adjacentto the first area.
 14. The immersive display of claim 13, where thelocation of the second area does not correspond to an area substantiallyhorizontally adjacent to the first area.
 15. An immersive display,comprising: a body; at least one display inside of the body fordisplaying images to a user of the immersive display; a processorcoupled to the at least one display and operable to: obtain first imagesfor display on the at least one display, where the first images aregenerated by software; obtain second images for display on the at leastone display from one or more second cameras, where the one or moresecond cameras capture, at least in part, a region not in front of theimmersive display; display the first images in a first area of the atleast one display; and display the second images in a second area of theat least one display.
 16. The immersive display of claim 15, where thesecond images are displayed at a location without reference to acorrespondence between the location and the region captured by the oneor more second cameras.
 17. The immersive display of claim 15, where thesecond images are displayed at a location that does not correspond tothe region captured by the one or more second cameras.
 18. The immersivedisplay of claim 15, where a location of the second area corresponds toan area substantially horizontally adjacent to the first area.
 19. Theimmersive display of claim 15, where a location of the second area doesnot correspond to an area substantially vertically adjacent to the firstarea.
 20. The immersive display of claim 19, where the location of thesecond area does not correspond to an area substantially verticallyadjacent to the first area.